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ABSTRACT 

Objective: Describe the development and 
psychometric validation of a brief scale (the Sleep 
Condition Indicator (SCI)) to evaluate insomnia 
disorder in everyday clinical practice. 
Design: The SCI was evaluated across five study 
samples. Content validity, internal consistency and 
concurrent validity were investigated. 
Participants: 30 941 individuals (71% female) 
completed the SCI along with other descriptive 
demographic and clinical information. 
Setting: Data acquired on dedicated websites. 
Results: The eight-item SCI (concerns about getting 
to sleep, remaining asleep, sleep quality, daytime 
personal functioning, daytime performance, duration of 
sleep problem, nights per week having a sleep problem 
and extent troubled by poor sleep) had robust internal 
consistency (a>0.86) and showed convergent validity 
with the Pittsburgh Sleep Quality Index and Insomnia 
Severity Index. A two-item short-form (SCI-02: nights 
per week having a sleep problem, extent troubled by 
poor sleep), derived using linear regression modelling, 
correlated strongly with the SCI total score (r=0.90). 
Conclusions: The SCI has potential as a clinical 
screening tool for appraising insomnia symptoms 
against Diagnostic and Statistical Manual of Mental 
Disorders, Fifth Edition (DSM-5) criteria. 



INTRODUCTION 

Although insomnia is the most common of all 
mental health problems, 1 it is seldom 
adequately assessed and treatment services are 
often poor. 2 3 This perhaps reflects the per- 
spective that insomnia is usually a symptom, 4 
coupled with minimal medical education on 
sleep and its disorders. 5 However, there are 
three reasons why this perspective must now 
change. First, insomnia is not merely a 
symptom. It has for some time been proposed 
as a genuine diagnosis (see Harvey review), 6 
and recently the Diagnostic and Statistical 
Manual of Mental Disorders, Fifth Edition 
(DSM-5) Work Group recognised that the 
previous dichotomy of primary versus 



Strengths and limitations of this study 



■ Existing instruments used to evaluate insomnia 
lack specificity or do not permit assessment 
against the latest diagnostic criteria. 

■ This study describes the development and valid- 
ation of a new instrument (the Sleep Condition 
Indicator (SCI)) for use in everyday clinical 
practice. 

■ The SCI is valid, reliable and sensitive to change 
in insomnia severity. Its brevity and appealing 
visual format permit rapid assessment and inter- 
pretation of poor sleep against contemporary 
clinical diagnostic criteria. 

■ While we have used large surveys and treatment 
evaluation to assess SCI properties, more work 
is required to assess predictive validity with ref- 
erence to independent clinical evaluation of 
insomnia disorder. 

secondary insomnia is not evidence based. 7 8 
Accordingly, DSM-5 now recommends that 
'insomnia disorder' should be coded "when- 
ever diagnostic criteria are met whether or not 
there is a co-existing physical, mental or sleep 
disorder". 9 Second, insomnia is not necessarily 
transient or benign. Once established, it is 
remarkably persistent, 10 11 constituting a risk 
factor for the development of physical and 
mental health problems, notably depres- 
sion, 12-14 as well as adverse effects on quality of 
life. 15 16 Chronic insomnia is also associated 
with high societal cost 17 and is, for example, a 
robust predictor of work disability. 18 Third, 
insomnia is treatable. There is a very substan- 
tial level 1 evidence-base, evaluating pharma- 
cological and cognitive-behavioural therapies 
(CBTs), 19 20 although the latter are very 
seldom available. 3 21 

Insomnia is ubiquitous, 22 so it is important 
that clinicians, general practitioners in par- 
ticular, have a reliable, valid and brief screen- 
ing tool. A wide range of such instruments is a 
standard part of patient-centred care, 23 for 
example, for depression, 24 anxiety 25 and 
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alcohol problems. In the insomnia field, two scales in 
particular are widely used: the Pittsburgh Sleep Quality 
Index (PSQI) 27 and the Insomnia Severity Index (ISI). 28 
The PSQI is an established research tool, which has a 
cut-off score indicative of sleep disturbance. However, it 
lacks specificity for insomnia. The ISI is very sound psy- 
chometrically, and is more specific and based on DSM-IV 
criteria for insomnia. It is used in the main to select 
people for clinical trials and as an outcome measure. 

In this paper, we present a further measure (the Sleep 
Condition Indicator (SCI)) that may have some useful 
features. The SCI is informed by the development phase 
for DSM-5 insomnia disorder, 7 8 coupled with published 
research diagnostic criteria 29 and recommended quanti- 
tative parameters for sleep disturbance. 30 In keeping with 
DSM-5, the SCI also evaluates associated daytime factors, 
which are important drivers of clinical symptoms 22 and 
should be incorporated in insomnia measurement. 15 16 31 
In terms of utility, the SCI is brief but versatile. It yields 
(1) a dimensional perspective on sleep quality: on an 
intuitive, global scale where higher scores represent 
better sleep; (2) a visual profile of night-time and 
daytime symptoms that the clinician can use in 
consultations and (3) indicative cut-off points for 
clinically-significant insomnia. This paper summarises 
the development and evaluation of the SCI across several 
studies, and in doing so addresses two major questions. 
First, does the SCI have adequate psychometric proper- 
ties? Second, is it possible to derive an even briefer, short 
form, SCI that has similar psychometric characteristics? 

METHODS 

Sample characteristics 

Data are reported from five validation studies (total 
n=30 941; 71% female) in which SCI items were adminis- 
tered. The Great British Sleep Survey (GBSS) was an 
open access, web-based survey completed by adults (18 
+years) with a UK postcode yielding data on 12 628 par- 
ticipants (72% female; mean age=38.7 years (SD=14.5)) 
between February 2010 and August 201 1. 32 The GBSS+ 
was a revision of the GBSS, extended to any valid zip 
code worldwide, from May 2011 to March 2012 
(n=11017; 68% female; 42.3 years (16.5)). The TV 
sample was obtained in response to a network pro- 
gramme (the Food Hospital, Channel 4) on the sleep 
benefits of tart cherry juice (n=6876; 76% female, 
36.4 years (13.3)). Glasgow Science Centre data (n=256; 
56% female, 40.3 years (14.9)) were collected in 2009- 
2010 during a study which assessed the relationship 
between salivary a-amylase, sleep pressure and diurnal 
preference. 33 Finally, a randomised controlled trial 
(RCT) sample comprised 164 participants (72% female, 
48.9 years (13.7)) recruited into a placebo-controlled 
evaluation of CBT for insomnia. 34 Ethical agreement 
concerning the latter two studies is provided in the 
source manuscripts. For the open access web surveys, 
participation was covered by the site terms. 



Across our combined largest samples (GBSS, GBSS+, 
TV), women were slightly younger than men (38.5 
(14.9) vs 40.1 (14.7) years; t (27 638) =7.94, p<0.0001) 
and the great majority was in average or better physical 
health (86%) and mental health (82%; 5-point scale: 0 
'very good', 1 'good', 2 'average', 3 'poor' and 4 'very 
poor'). Respondents who made some use of prescription 
sleeping pills (9.1%) were 7 years older than those who 
did not (46.2 (15.1) vs 39.1 (15.1) year, t(20 813)=19.6, 
p<.0001) and had a substantially poorer SCI score (8.56 
(4.93) vs 15.6 (7.80), t(20 813)=38.8, p<0.0001). Of the 
total sample, 18.1% took over-the-counter sleep aids 
(OTCs), and more than one-third of those taking sleep- 
ing pills also used OTCs. 

Design and measurement 

This is a psychometric scale development study. 
Standard approaches to the appraisal of validity, reliabil- 
ity and sensitivity were applied, making appropriate 
selection among the available datasets. These methods 
and datasets will be introduced in an integrated way in 
subsequent sections, so that the research process can be 
more clearly expressed and understood. 

RESULTS 

Development of the SCI 

Content validity 

An eight-item scale was developed (see appendix) based 
on DSM-5 workgroup draft criteria that were available at 
the time (in 2010). 7 8 At that stage, a consultation 
process was underway and draft information was posted 
on the American Psychiatric Association website. 
Consequently, the SCI items generated comprised two 
quantitative items on sleep continuity (item 1, getting to 
sleep; item 2, remaining asleep), two qualitative items 
on sleep satisfaction/dissatisfaction (item 4, sleep 
quality; item 7, troubled or not), two quantitative items 
on severity (item 3, nights per week; item 8, duration of 
problem) and two qualitative items on attributed 
daytime consequences of poor sleep (item 5, effects on 
mood, energy or relationships (personal functioning); 
item 6, effects on concentration, productivity or ability 
to stay awake (daytime performance)). 

Validated quantitative criteria for sleep disruption (eg, 
31-45 min to fall asleep) served as responses for sleep 

8 29 30 

continuity items 1 and 2. Items 5 and 6 on 

daytime effects were derived by principal components 
analysis (PCA; Varimax rotation) of six individual pro- 
posed DSM-5 impact areas, using combined datasets 
(GBSS, GBSS+, TV, RCT: valid n=29 650). PCA yielded 
satisfactory Kaiser-Meyer-Olkin (KMO=0.874) and 
Bartlett (p<0.0001) statistics. Iteration converged after 
three rotations. A two component model (derived from 
inspection of the scree plot and a criterion for asso- 
ciated variance >10%) explained 75.8% of total vari- 
ance, with item loadings >0.60. Component 1 
(eigenvalue=3.83; 63.8% of variance) comprised 'mood' 
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(loading=0.812), 'energy' (0.651) and 'relationships' 
(0.859), and was subsequently named 'personal func- 
tioning'. Component 2 (eigenvalue=0.72; 12.0% of vari- 
ance) comprised 'concentration' (0.719) and 'get 
through work' (0.724), and 'stay awake' (0.875) may be 
regarded as 'daytime performance'. PCA offered a rela- 
tively pure solution, although 'energy' also loaded sig- 
nificantly on component 2 (0.519). 

We then investigated the inter-relationships of our 
eight SCI items using the same methodology, but apply- 
ing this time a minimum item loading of 0.40, to permit 
incorporation of all eight items. PCA with Varimax 
Rotation (KMO=0.888; Bartlett, p<0.0001) yielded a two 
component solution (66.4% explained variance). 
Component 1 (eigenvalue=4.256, 53.2% variance), 
named 'sleep pattern', comprised items 1, 2, 3, 4 and 8 
with factor loading ranging from 0.453 to 0.776. 
Component 2 (eigenvalue=1.06, 13.2% variance), 
named 'sleep-related impact', comprised item 5 (factor 
loading 0.886) and item 6 (0.911). Consistent with clin- 
ical presentation, concerns about sleep (item 7) loaded 
significantly and similarly on 'sleep pattern' (0.616) and 
'sleep-related impact' components (0.576). 

Response format 

Each item was scored on a 5-point scale (0-4), with 
lower scores, in the 0-2 range, reflecting putative thresh- 
old criteria for insomnia disorder (shaded area: see 
appendix). The clinician can then see at a glance the 
profile of possible concerns. The possible total score 
ranges from 0 to 32, with higher values indicative of 
better sleep. However, scores can be readily transformed 
into a more intuitive 0-10 SCI range, either by dividing 
the total by 3.2, or by using an online version with auto- 
mated scoring, which is available free of charge (http:// 
www.sleepio.com/ clinic/) . 

Concurrent validity and association with related domains 

Data from the Science Centre sample demonstrated that 
the SCI correlates inversely with the PSQI (r=— 0.734) 
and the ISI (r=— 0.793), suggesting measurement proper- 
ties consistent with these related measures. There was 
also a small but significant association of sleep condition 
with self-rated physical health (r=0.222), and an associ- 
ation also with mental health (r=0.335). Using more spe- 
cific measures, in the Science Centre sample, 
correlation of the SCI with symptoms of depression (r= 
-0.426) and anxiety (r=— 0.400) on the Hospital Anxiety 
and Depression Scale 35 was modest, and greater than we 
observed in our RCT sample (on the Depression Anxiety 
Stress Scale 36 : depression (r=— 0.267), anxiety (r=— 0.236) 
and stress (r=-0.263)). 

We have not at this stage tested the discriminant validity 
of the SCI against clinical diagnosis of insomnia disorder. 
As a first step, however, using our Science Centre sample, 
we tested the concurrent validity of SCI cut-offs 
(score <16), reflecting the minimum criteria for putative 
insomnia disorder (see appendix), against published, 



validated ISI cut-off scores. We first categorised our 
sample according to ISI ranges (ISI score=0-14, reflect- 
ing 'no insomnia disorder' (n=228) vs 'probable insom- 
nia disorder' ISI score=15-28, n=27)) and conducted an 
independent t test on SCI total score. The mean SCI 
values for the 'probable insomnia disorder' category were 
10.7 (SD=5.3) vs 22.9 (SD=6.2) for 'no insomnia disorder' 
(t=9.86, p<0.0001). Applying an SCI cut-off <16, 89% of 
the sample was correctly identified as having 'probable 
insomnia disorder' (ISI scores of >15), while an SCI 
score of >16 correctly identified 82% of those with 'no 
insomnia disorder'. These findings provide further evi- 
dence of concurrent validity for the SCI and help to 
confirm that a score of <16 on the SCI seems reasonable 
to detect possible insomnia disorder. 

Internal consistency 

Cronbach's a for the GBSS sample was strong at 0.857 
(range of a-if-item-deleted 0.822-0.860). Replication of 
these internal consistency data was obtained from the 
GBSS+ sample (oc=0.865) . The mean corrected item-total 
correlation was moderate (r=0.620), indicating a substan- 
tial unique variance per item (shared variance=38%). 

Sensitivity to change 

We have previously reported that the SCI is sensitive as a 
measure of treatment outcome. 

Short-form version of the SCI 

Although the SCI is brief, in clinical practice ultra short- 
form scales are often helpful (eg, generalised anxiety dis- 
order (GAD) 2-items) . 37 Accordingly, we conducted a step- 
wise linear regression analysis to determine which subset 
of items (independent variables) explained the greatest 
proportion of variance in the dependent variable, SCI 
total score. A two-item (SCI-02), comprising item 3 'how 
many nights' (standardised (3=0.515) and item 7 'troubled 
you in general' ((3=0.491), together predicted 82% of vari- 
ance (adjusted R 2 =0.820) in the full scale SCI (R 2 
change=0.672 + 0.148; F(227 637)=62 770, p<0.0001). As a 
check on the independence of residuals, we computed the 
Durbin-Watson statistic, which was found to be 1.80, sug- 
gesting no serial correlation. The SCI-02 also correlated 
strongly with the SCI score total (r=0.904) . 

DISCUSSION 

A prerequisite to improved insomnia care is the availability 
and regular use of reliable and valid insomnia assessment. 
Only then can a clinical problem be recognised as distinct 
from normal variation, and a persistent problem be differ- 
entiated from a transient one. We have reported here the 
development and preliminary validation of the SCI, a 
DSM-5 compliant, brief screening measure that may be fit 
for such purposes. Results indicate that the SCI is intern- 
ally consistent, sensitive to change and correlates strongly 
with established screening instruments, known to be sensi- 
tive to clinical insomnia (PSQI and ISI). PCA revealed a 
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two-component solution (66% of the variance), reflecting 
the underlying complaint of insomnia; that is, concerns 
about sleep pattern and concerns about the impact of 
poor sleep, both of which need to be addressed in clinical 
practice. The derived two-item short-form version, focus- 
ing on the severity of the presenting complaint coupled 
with frequency of the sleep problem, correlated strongly 
with total SCI score and we would suggest that these might 
be the lead questions for a clinician to use in the context 
of their consulting room practice. 

Of course, further work is required, particularly 
real-world studies of how the SCI might be used in 
population screening and in the evaluation of outcome 
following an episode of care. While comparisons with 
ISI cut-offs provide evidence of concurrent validity and 
indicate that an SCI score <16 may help detect probable 
insomnia disorder, studies of predictive validity with ref- 
erence to independent clinical evaluation of insomnia 
disorder (the gold standard) are essential before firm 
conclusions can be made. 

It should be noted that over half of the respondents to 
our online surveys screened positive for possible insom- 
nia disorder. These, of course, are not prevalence data 
as we did not adopt a formal population sampling 
approach. Nevertheless, the inevitable bias of these 
open access surveys towards those with sleep concerns 
does permit us (1) to profile many respondents against 
criteria; (2) to conduct powerful analyses of the proper- 
ties of the SCI and (3) to make comparisons with size- 
able cohorts of good sleepers. Importantly, for our 
Science Centre sample, approximately 10% scored in 
the probable insomnia disorder range (ISI score >15), 
consistent with prevalence data, 2 providing further 
support for our ISI-SCI concurrent validity analysis. 

Furthermore, a limitation of the SCI is that it does not 
contain specific questions relating to early morning awa- 
kenings (EMA; premature awakening with inability to 
return to sleep) — a symptom which has recently been 
incorporated into DSM-5 criteria. While established 
insomnia questionnaires, including the ISI 28 and Athens 
Insomnia Scale, 37 probe perceived severity of EMA, 
quantitative values for EMA, to our knowledge, are yet 
to be defined. To some extent, SCI item 2 on wakeful- 
ness during the night may capture this symptom, com- 
plaint, but we recommend that the clinician follows up a 
'positive' answer to locate the nature and temporal pos- 
ition of wakefulness during the sleep period. Moreover, 
other core DSM-5 criteria do not feature as SCI items 
(eg, the sleep difficulty occurs despite adequate oppor- 
tunity for sleep; the insomnia is not better explained by 
and does not occur exclusively during the course of 
another sleep-wake disorder; and the insomnia is not 
attributable to the physiological effects of a substance). 
However, these items are not easy to probe unambigu- 
ously with a self-completed psychometric instrument and 
would require careful scrutiny by a treating clinician. It 
is, of course, possible that sleep disorders other than 
insomnia (eg, circadian rhythm sleep disorders, sleep- 



breathing disorders) may also lead to low scores on the 
SCI. Thus, the SCI should be viewed as an insomnia 
screening tool, consistent with features of DSM-5, but 
requiring careful follow-up in clinical practice to fully 
define the nature of sleep disturbance. 
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APPENDIX 



Appendix: The sleep condition indicator 



Score 



Item 



Thinking about a typical night in the last month ... 

1. ... how long does it take you to fall asleep? 

2. ... if you then wake up during the night ... how long 
are you awake for in total? (add all the wakenings up) 

3. ... how many nights a week do you have a problem 
with your sleep? 

4. ... how would you rate your sleep quality? 
Thinking about the past month, to what extent has poor sleep 

5. ... affected your mood, energy, or relationships? 

6. ... affected your concentration, productivity, or ability to 
stay awake 

7. ... troubled you in general 
Finally ... 

8. ... how long have you had a problem with your sleep? 



0-15 min 
0-15 min 


16-30 min 
16-30 min 


31-45 min 46-60 min >61 min 
31-45 min 46-60 min >61 min 


0-1 


2 


3 4 5-7 


Very good 
sleep ... 
Not at all 
Not at all 


Good 


Average Poor Very poor 


A little 
A little 


Somewhat Much Very much 
Somewhat Much Very much 


Not at all 


A little 


Somewhat Much Very much 


I don't have a 
problem/<1 mo 


1-2 mo 


3-6 mo 7-12 mo >1 yr 



Scoring instructions: 

Add the item scores to obtain the SCI total (minimum 0, maximum 32). 
A higher score means better sleep. 

Scores can be converted to 0-10 format (minimum 0, maximum 10) by dividing total by 3.2. 
Item scores in grey area represent threshold criteria for Insomnia Disorder. 
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